Mind Peek: Singapore Art Museum Visual Experience
Mind Peek is an museum exhibit designed by the National University of Singapore (NUS) team, a response to ‘Museum Alive’, a joint studio offered by the NUS Engineering Design and Innovation Centre, Industrial Design and Architecture that seeks to push the boundaries of museum experiences. This is the first collaboration between NUS College of Design & Engineering and Singapore Art Museum (SAM).
Mind Peek invites visitors to step into the mind’s inner workings through a participatory collective experience of emotions. By peeking into the world of others around them, visitors gain a new perspective of how their emotions can transverse space and time as colourful orbs. Through interaction with people from distal worlds, visitors can gain a deeper comprehension of the lasting impact of their emotions, fostering empathy and introspection.
Technical Implementation
By leveraging facial recognition technology, we were able to transform expressions into visuals, manifesting as radiant orbs of color. Mind Peek uses AI computer vision technology to detect human facial features and decipher the subtle changes and nuances of human emotions.
By integrating Convolutional Neural Network (CNN) technology, the Mind Peek project deployed an advanced AI model for real-time recognition of multiple emotions. Through the integration of advanced Python-based facial recognition library and MQTT IoT public broker for seamless data handling, the system translates facial expressions into dynamic orbs of color, forming the immersive virtual environment within Unity. These visually striking orbs serve as tangible representations of the intricate complexities within our emotional spectrum.
About the Artists
Lucas Tay
Lucas is a Biomedical Engineering, and Innovation Design graduate. As an innovation enthusiast, he is always looking for new ways to combine design and engineering fundamentals to create inspiring projects. Currently working in logistics innovation, he aspires to bring positive change to the world with his passion for creativity and relentless drive to translate ideas into impactful solutions.
Joanne Chandini Joseph
Joanne is a Biomedical Engineering, and Innovation & Design graduate who enjoys building electrical projects through open-source software platforms and circuitry. She hopes to showcase the artistic nature of engineering and aspires to achieve this outcome through multidisciplinary collaboration.
Jay Ng Yu Zhe
Yu Zhe is a Chemical Engineering, and Innovation & Design graduate who is interested in artificial intelligence and coding, particularly in the areas of deep learning. He enjoys working in an interdisciplinary setting, where robust ideas can flow freely and be efficiently put into action.
Janessa Song Mun Yoong
Janessa is a Chemical Engineering, and Innovation Design graduate. Innovation design led her to finetune her creativity by explorating the different ways to intertwine art and engineering. She is currently a process control engineer, seeking innovative ways to increase efficiency in the operation of the plant.
Srikesh Sundaresan
Kesh is a current fourth-year Industrial Design student, and creative technologist. By fusing design and creative technologies, he crafts immersive experiences that evoke emotions. With a passion for visual storytelling, he channels his expertise into visualising exhibits that invite viewers to embark on journeys of discovery.
Avik Chari
Avik is an esteemed composer and sound designer with a career spanning over six years. His expertise in music composition has found resonance in video games, animations, and installations, with credits including "Big Ideas 2022" by ARK Invest. As the founder of Liria Music Prep, Avik has played an instrumental role in music preparation, with successful projects involving large orchestras and individual composers. His experience with the Singapore Symphony Group and orchestras in Boston further showcases his dedication to orchestral music. Avik's proficiency in audio mixing and editing, including work with Logic Pro, Pro Tools, and Reaper, is a testament to his comprehensive skill set. His work can be explored at www.avikchari.com and www.liriamusicprep.com.
